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Basis of the report 
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, received on with the letter of 



X the claims, 



With regard to the elements of the international application:* 
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[xl the description, pages 1-15, as originally filed, 

pages 
pages 
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pages 1-15, as originally filed, 
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pages 5 received on with the letter of 



X the drawings, 
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filed with the demand 
received on with the letter of 



pages , 
pages , 
pages , 



With regard to the language, all the elements marked above were available or furnished to this Authority in the language in 
which the intemational application was filed, unless otherwise indicated under this item. 
These elements were available or furnished to this Authority in the following language which is: 
I I the language of a translation furnished for the purposes of intemational search (under Rule 23.1(b)). 

I I the language of publication of the intemational application (under Rule 48.3(b)). 
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I I The statement that the subsequently furnished written sequence listing does not go beyond the disclosure in the 
intemational application as filed has been furnished. 

I I The statement that the information recorded in computer readable form is identical to the written sequence listing has 
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I I The amendments have resulted in the cancellation of: 

I I the description, pages 

[ I the claims, Nos. 

I I the drawings, sheets/fig. 

I I This report has been established as if (some of) the amendments had not been made, since they have been considered to 
go beyond the disclosure as filed, as indicated in the Supplemental Box (Rule 70.2(c)).** 



Replacement sheets which have been furnished to the receiving Office in response to an invitation under Article 14 are referred to in this 
report as "originally filed" and are not annexed to this report since they do not contain amendments (Rules 70.16 and 70. 1 7). 

Any replacement sheet containing such amendments must be referred to under item I and annexed to this report 
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2. Citations and explanations (Rule 70.7) 



The claims are novel and inventive as no prior document discloses the features of fitting multiple images of an 
organ to a reference model, user defining guide points on the model and images and thus forming a three 
dimensional model of the organ from w^hich characteristics may be measured. 
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CLAIMS 

1 . A method of assessing one or more characteristic(s) of an organ or part thereof 
from multiple images of the organ or part thereof, the method comprising the work flow 
steps of: 

defming the spatial position of at least two of the images; 

forming an initial fit between a reference model of the geometric shape of the 
organ or part thereof and the images according to reference markers on the images; 

manually user-defining one or more reference guide points eissociated with one 
or more images displayed to a user, for which the spatial positions have been defined; 

converting the guide points to three-dimensional coordinates; 

improving the fit of the model by fitting the model to the guide points to form an 
estimate model for the organ or part; and 

assessing the one or more characteristic from the estimate model. 

2. A method as claimed in claim 1 including forming the initial fit between the 
reference model and the images by defining a point on each of two images, defining a 
reference line in 3 -dimensional space between the point, calculating the distance as a 
function of the length of the reference line, and at least approximately matching the scale 
of the reference model and the images according to the distance between the points, 

3. A method as claimed in claim 2 wherein the reference model comprises a 
miathematically defined reference model . 

4. A method as claimed in claim 3 wherein the reference model comprises an 
ellipsoid having the reference line as a central axis and one or more surface points^ each 
surface point specified by a radial distance firom the central axis. 

5. A method as claimed in any one of the preceding claims comprising the steps of 
displaying one or more images to a user and superimposing on the image a representation 
of the intersection of the reference model with the image. 
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6. A method as claimed in claim 5 further comprising the step of performing image 
processing on one or more of the images. 

7. A method as claimed in claim 5 or claim 6 wherein the reference points are 
boundary points on the image(s). 

8. A method as claimed in any one of the preceding claims further comprising the 
step of calculating the volume of the subject organ or part from the estimate model. 

9. A method as claimed in any one of the preceding claims further comprising the 
step of calculating the mass of the subject organ or part firom the estimate model. 

10. A method as claimed in any one of the preceding claims wherein the subject 
organ comprises a ventricle of the heart and the characteristics measured include 
ventricular mass, endocardial volume and/or wall thickness of all of the ventricle or part 
thereof 

11. A method as claimed in any one of the preceding claims wherein the subject 
organ comprises a ventricle of the heart and the characteristics measured include 
ventricular abnormalities identified through changes in wall thickness over time. 

12. A method as claimed in any one of claims 1 to 9 wherein the subject organ 
comprises a kidney and the characteristics measured include cortical thickness. 

13. A system for assessing one or more characteristics of an organ or part thereof of a 
subject from multiple images of the subject's organ or part thereof, the system 
comprising; 

a memory in which is stored the spatial position of at least two of the images; 
initial fitting means arranged to fomi an initial fit between a reference model of 
the organ or part thereof according to reference markers on the images; 

17 
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reference guide point definition means enabling a user to define one or more 
reference guide points associated with one or more images displayed to the user, for 
which the spatial positions are stored in the memory; 

conversion means arranged to convert the guide points to three-dimensional 
coordinates; 

fit improving means arranged to improve the fit of the reference model to the 
guide points to form an estimate model for the organ or part thereof; and 

^ calculation means arranged to assess the one or more characteristics firom the 
estimate model. 



14, A system as claimed in claim 13 whereha the fitting means is arranged to form the 
initial fit between the reference model and the images by defining a point on each of two 
images, defining a reference line in 3 -dimensional space between the points,calculating 
the distance as a function of the length of the reference line, and at least approximately 
matching the scale of the reference model and the images according to the distance 
between the points. 

15- A system as claimed in claim 14 wherein the reference model comprises a finite 
element model, 

16. A system as claimed in claim 15 wherein the reference model comprises an 
ellipsoid having the reference line as a central axis and one or more surface points, each 
surface point specified by a radial distance from the central axis. 



17. A system as claimed in any one of claims 13 to 16 fiirther comprising display 
means arranged to display one or more images to a user and to superimpose on the image 
a representation of the intersection of the reference model with the image slice. 

18. A system as claimed in claim 17 fiirther comprising image processing means 
arranged to perform image processing on one or more of the images. 
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19. A system as claimed in claim 17 or claim 18 wherein the reference guide point 
definition means is arranged to obtain preferred guide point positions from a user. 

20. A system as claimed in any one of claims 13 to 19 ftarther comprising volume 
calculation means arranged to calculate the volume of the subject organ or part fi-om the 
estimate model. 



21. A system as claimed in any one of claims 13 to 20 further comprising mass 
calculation means arranged to calculate the mass of the subject organ or part from the 
estimate model. 



22. A system as claimed in any one of claims 13 to 21 wherein the subject organ 
comprises a ventricle of the heart and the characteristics measured include ventricular 
mass, endocardial volume and/or wall thickness of all of the ventricle or part thereof. 

23. A system as claimed in any one of claims 13 to 22 wherein the subject organ 
comprises a ventricle of the heart and the characteristics measured include ventricular 
abnormalities identified through changes in wall thickness over time. 

24. A system as claimed in any one of claims 13 to 21 wherein the subject organ 
comprises a kidney and the characteristics measured include cortical thickness. 

25. A computer program for assessing one or more characteristics of an organ or part 
thereof of a subject from multiple images of the subject's organ or part thereof, the 
program comprising: 

storage means arranged to store the spatial position of at least two of the images; 

initial-fitting means arranged to form an initial fit between a reference model of 
the organ or part thereof according to the reference markers on the images; 

reference guide point definition means enabling a user to define one or more 
reference guide points associated with one or more images displayed to a user, for which 
the spatial positions are stored in the memory; 
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conversion means arranged to convert the guide points to three-dimensional 
coordinates; 

fit improving means arranged to improve the fit of the reference model to the 
guide points to form an estimate model for the organ or part thereof; and 

calculation means arranged to assess the one or more characteristics from the 
estimate model. 

26. A program as claimed in claim 25 wherein the initial-fitting means is arranged to 
form the initial fit between the reference mode and the images by defining a point on 
each of two images, defining a reference line in 3-dimensionaI space between the points, 
calculating the distance as a fimction of the length of the reference Ime, and at least 
approximately matching the scale of the reference model and the images according to the 
distance between the points, 

27. A program as claimed in claim 26 wherein the reference model comprises a finite 
element model . 

28. A program as claimed in claim 27 wherein the reference model comprises an 
ellipsoid having the reference line as a central axis and one or more surface points, each 
surface point specified by a radial distance from the central axis. 

29. A program as claimed in any one of claims 25 to 28 further comprising display 
means arranged to display one or more images to a user and to superimpose on the image 
a representation of the intersection of the reference model with the image* 

30. A program as claimed in claim 29 fiirther comprising image processing means 
arranged to perform image processing on one or more of the images. 

31. A program as claimed in claim 29 or claim 30 wherein the reference guide point 
definition means is arranged to obtain preferred guide point positions from a xiser. 
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32. A program as claimed in any one of claims 25 to 31 further comprising volume 
calculation means arranged to calculate the volume of the subject organ or part from the 
estimate model. 



33. A program as claimed in any one of claims 25 to 32 further comprising mass 
calculation means arranged to calculate the mass of the subject organ or part from the 
estimate model. 



34. A program as claimed in any one of claims 25 to 33 wherein the subject organ 
comprises a ventricle of the heart and the characteristics measured include ventricular 
mass, endocardial volume and/or wall thickness of all of the ventricle or part thereof 

35. A program as claimed in any one of claims 25 to 34 wherein the subject organ 
comprises a ventricle of the heart and the characteristics measured include ventricular 
abnormalities identified through changes in wall thickness over time. 

36. A program as claimed in any one of claims 25 to 33 wherein the subject organ 
comprises a kidney and the characteristics measured include cortical thickness. 

37. A computer program as claimed in any one of claims 25 to 35 embodied on a 
computer readable medium, 

38. A method of assessing one or more characteristic(s) of an organ or part thereof 
from multiple images of the organ or part thereof, the method comprising the work flow 
steps of; 

defining the spatial position of at least two of the images; 

forming an initial fit between a reference model of the organ or part thereof and 
the images; 

manually user-defining one or more reference guide points associated with one 
or more images displayed to a user, for which the spatial positions have been defined; 
converting the guide points to three-dimensional coordinates; 
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improving the fit of the model by fitting the model to the guide points to fomi an 
estimate model for the organ or part; and 

assessing the one or more characteristic from the estimate model. 

39. A method as claimed in claim 38 including foraiing the initial fit between the 
reference model and the images by defining a point on each of two images, defining a 
reference line in 3 -dimensional space between the point, calculating the distance as a 
function of the length of the reference line, and at least approximately matching the scale 
of the reference model and the images according to the distance between the points. 
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ing the steps of defining the spatial position of at least two of the images; defining a 
reference model of the organ or part thereof scaled according to the distance between 
reference markers on the images; defining one or more boundary guide points associated 
with one or more images for which the spatial positions have been defined; converting the 
guide points to three-dimensional coordinates; defining an estimate model by fitting the 
reference model to the guide points; and calculating the characteristics from the estimate 
model. The invention also provides a system and a computer program for measming 
characteristics of an organ or part thereof of a subject from multiple images of the sub- 
ject's organ or part thereof. 
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BIBTHOD AND SYSTEM OF MEASURING CHARACTERISTICS OF AN ORGAN 

FIELD OF THE INVENTION 

5 The invention relates to a method and system of measuring characteristics of an 
organ or part thereof. The method and system of the invention are particularly suited 
to measuring cardiac function, volume, and/or mass of a ventricle of the heart of a 
subject from multiple image slices obtained by magnetic resonance imaging (MRI). 
The method and system of the invention may also be used to calculate the volume 
10 and/ or mass and other characteristics of other organs such as a lung, kidney or 
brain, to measure the position of the wall of a blood vessel for the purposes of 
anafysis of flow, or to calculate the volume and/or mass of a bone, tumour or cyst. 



1 5 BACKGROUND TO INVENTION 

Ventricular mass, volumes and wall thickness at end diastole and end systole are 
essential clinical parameters for diagnosis and management of many cardiac 
diseases. Magnetic resonemce imaging (MRI) may be used to estimate heart wall 
20 motion by reconstructing the shape and motion of the left ventricle. 

MRI is also able to provide accurate and precise estimations of ventricular mass, 
volume and wall thickness, since it is a true 3-dimensional method which is not 
dependent on geometric assumptions and is not limited in the position or orientation 
25 of the piossible images, unlike other methods, such as for example echocardiography 
or computed tomography. 

Recent advances in MRI allow the acquisition of 10 to 20 MRI images or slices in 
- short and long axis or arbitrary orientations, each with 10 to 25 frames through the 
30 cEo-diac cycle in real time, or ten to fifteen minutes or less, which is a clinically 
acceptable time. Previous studies have shown that the summation of areas ouUined 
in short axis MRI slices gives more accurate and reproducible estimates of volume 
than echoceirdiography or LV angiography. 

35 A major limitation of the MRI slice summation method is the prohibitive time 
required to outline the endocardial and epicardial boundaries of the left ventricle in 
each slice. This severely limits application of the use of the technique to routine 
clinical care. 
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In the past, many semi-automated image segmentation algorithms have been applied 
to this problem, but these solutions are frequently not sufiBciently robust and 
accurate for routine clinical use. In particuleu^ the image pixel intensities are 
5 insufficient to adequately constrain the segmentation problem, due to the limited 
temporal and spatial resolution, presence of image artifacts, and lack of contrast 
between blood and muscle. The amount of time spent on manual editing and 
correction of contours obtained from these previous solutions renders automated 
methods nearly as slow as manual contouring in clinical practice. 

10 

Other techniques apply model fitting techniques to estimate characteristics of organs 
such as the left ventricle, T Mclnemey and D Terzopoulos in "A Dynamic Finite 
Element Surface Model for Segmentation and Tracking in Multidimensional Medical 
Images with Application to Cardiac 4D ImEige Anadysis", Computerized Medical 

15 Imaging and Graphics 19:69-83; 1995 describe a deformable "balloon" model that is 
topologically isomorphic to a sphere for use in estimating volume and motion of the 
left ventricle. PCT international patent publication WO 99/ 18450 to Philips AB titled 
"Method of and Device for Imaging an Object by means of Magnetic Resonance* 
describes the use of an ellipsoid to model the left ventricle. Both techniques require 

20 the use of edge detection algorithms and in doing so suffer from the disadvantages 
discussed above. 

SUMMARY OP INVENTION 

25 In broad terms in one aspect the invention comprises a method of measuring 
characteristics of an organ or part thereof of a subject from multiple images of the 
subject's organ or part thereof, the method comprising the steps of defining the 
spatial position of at least two of the slices; defining a reference model of the organ or 
part thereof scaled according to the distance between the slices; defining one or more 

30 boundary guide points associated with one or more slices for which the spatial 
positions have been defined; converting the guide points to three-dimensional 
coordinates; defining an estimate model by fitting the reference model to the guide 
points; and calculating the characteristics from the estimate model. 

35 In broad terms in another aspect, the invention comprises a system for measuring 
characteristics of an organ or part thereof of a subject from multiple image slices of 
the subject's organ or part thereof, the system comprising a memory in which is 
stored the spatial position of at least two of the slices; reference model definition 
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means arranged to define a reference model of the orgein or part thereof scaled 
according to the distance between the slices; boundary guide point definition means 
arranged to define one or more boundeiry guide points associated with one or more 
slices for which the spatial positions are stored in the memory; conversion means 
5 arranged to convert the guide pK>ints to three-dimensional coordinates; estimate 
model definition means arranged to define an estimate model by fitting the reference 
model to the guide points; and calculation means arranged to calculate the 
characteristics firom the estimate model, 

10 In yet another form the invention comprises a computer program for measuring 
characteristics of an organ or part thereof of a subject from multiple image slices of 
the subject's organ or part thereof, the program comprising storage means arranged 
to store the spatial position of at least two of the slices; reference model definition 
means arranged to define a reference model of the organ or part thereof seeded 

15 according to the distance between the slices; boundary guide point definition means 
arranged to define one or more boundary guide points associated with one or more 
slices for which the spatial positions are stored in the memory; conversion meains 
arranged to convert the guide pK>ints to three-dimensional coordinates; estimate 
model definition means arranged to define an estimate model by fitting the reference 

20 model to the guide points; and calculation means arranged to csdculate the 
characteristics from the estimate model. 

BRIEF DESCRIPTION OF THE FIGURES 

25 Preferred forms of the invention will now be described, by way of example, with 
reference to the accompanying figures in which: 

Figure 1 is a flow chart outlining a preferred form of the method of the invention; 

30 Figure 2 shows the main window of a preferred form of an application program in 
which the invention is implemented; 

Figure 3 shows a guide points window and the preferred method of selecting the left 
ventricular basal slice from this window; 

35 

Figure 4 shows the preferred method of selecting the left ventricular apical slice from 
the window of Figure 3; 
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Figure 5 shows the preferred method of enteriiig characteristics of the right ventricle 
from the window of Figure 3; 

Figure 6 shows the preferred method of defining the base or mitral valve plane from 
5 the window of Figure 3; 

Figures 7 to 10 illustrate a method of selecting boundary guide points from the 
window of Figure 3; 

10 Figures 1 1 and 12 show a preferred window for viewing the model; and 

Figures 13 to 15 show preferred displays of data obtained from the method and 
system of the invention. 

15 DETAILED DESCRIPTION OF PREFERRED FORMS 

Figure 1 sets out a preferred form of method of the invention. 

A number of images are first obtained of the left ventricle of a subject as indicated at 
20 4-1-0. The images could be acquired from an MRI scanner, or may alternatively be 
acquired by an ultra-fast CT, 3-dimensional ultrasound machine or 
echocardiography , or other suitable imaging modality. The images could also be 
obtained from confocal microscopy, electron microscopy or histology. The images are 
tjrpically 2-dimensioncd cines or movies of the heart and are taken at standard 
25 orientations, for exemaple, short axis and long axis, or at entirely arbitrary positions 
depending on the nature of the pathology and imaging modality. 

The preferred images are acquired in a number of spatial locations, having a lowest 
or apical slice, a highest or basal slice, one or more middle slices and one or more 
30 long axis slices. The preferred images are acquired in between 2 and preferably 20 
spatial locations, and typically 12 spatial locations. Preferably images in. each of 
these spatial locations are obtained at multiple frames through the cardiac cycle. 
The preferred number of frames is 10 to 25. 

35 Conventional MRI imaging apparatus produces images having image headers. The 
image header in each image generally comprises an extensive data list including 
patient name and scan i^cirameters at the beginning of each image. The image 
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header also provides data representing the ispatial position and tezaporal position of 
each slice or frame. 



The images are loaded into memory as indicated at 112. The preferred memory forms 
5 part of a computer having a CPU, input devices and a display device such as a VDU. 
The preferred input devices comprise a keyboard, mouse and disk drive, typically a 
networked magneto- optical disc drive and /or CD ROM drive. Images may also be 
transferred over a network. The preferred memory comprises a hard disk drive 
suitable for storing the images. 

10 

The preferred computer comprises a SUN SparcStation, SGI work station, PC, or 
similar having at least 128 MB Ram or similar. The computer has loaded on it 
suitable operating system software, such as SOLARIS, IRIX, WINDOWS or LINUX. 
The preferred computer is arranged to execute application software in which the 

15 present invention has been developied. The preferred application software is written 
in C++, using OpenGL, Openlnventor and Xwindows for graphical interfaces- 
Referring to Figure 2, the user is presented with a main window from which a 
number of options may be selected. The option to load planes is indicated at 14 

20 which loads the three-dimensional position of the images and the option to load 
frames is indicated at 15 which loads the position of the images in time. This spatial 
and temporal information is generally included in the image headers. The option to 
load images is indicated at 16. Each separate image location is displayed in a 
second window at the first phase of imaging simultaneously. 

25 

Various parameters may be specified by the user at the time of loading the images, 
for example Model Type, Fit Type and Data Set. The user may also specify directory 
names for directories such as a Data Directory, a Model Directory and a Script 
Directory. 

30 

As shown at 114 in Figure 1, the next step is to define a three-dimensional co- 
ordinate system from two or more of the slices for which the spatial positions have 
been defined. The main window of Figure 2 presents to the user an option to enter 
the guide points editor. The guide points editor loads the editor window shown in 
35 Figure 3. The editor window includes panel 20 which in the preferred form displays 
thumbnail images of the images stored in the memory. Panel 22 displays an 
enlarged image of one of the images displayed in panel 20. The preferred form 
window shown in Figure 3 also provides the user with the ability to zoom and pan 
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images and to adjust brightness and contrast. The user may select the image to be 
displayed in panel 22 by, for example, clicking on one of the thumbnails displayed in 
panel 20. 

5 The user first selects the basal or highest short axis slice in panel 20, clicking on the 
thumbnail image to display the enlarged image in panel 22. In Figure 3 the user has 
selected the bcisal slice which is described below panel 22 as the seventh short axis 
image obtained during the first time interval or frame. 



10 The user selects the Base option indicated at 24. A prompt is displayed for the user 
to pick a point to represent the base in the model's cardiac coordinate system. The 
user selects a point in the centre of the ventricular image by cHcking in panel 22. 
Once the desired base has been selected the user selects the option to accept the 
base indicated at 26. 

15 

Referring to Figure 4, the user repeats the procedure to select the apex of the object. 
The user selects the Apex option indicated at 28. A prompt is displayed for the user 
to pick a pK>int representing the apex and the user then selects the point in peinel 22. 
Once the desired apex has been selected the user accepts the apex as indicated at 
20 30. 



If the spatial position of the basal slice and the apical slice is known then land marks 
may be determined, for example the long axis. The software calculates the length 
and position of the long axis by defining a line in 3-dimensional space between the 
25 two points selected by the user. 

As shown in Figure 5, the user is not limited to defining the co-ordinate system on 
the left ventricle. By selecting the option indicated at 35 the user may select 
different points or landmarks to analyse, for example, the right ventricle. 

30 

As shown in Figure 6, the user may display in panel 22 an image taken of the long 
axis of the object, as indicated by the description below panel 22. The user selects 
the Base Points option 32 which then prompts the user to choose two or more points 
on the image to define the maximum extent for estimate model and calculate 
35 volumes of, for example, the mitral valve plane. The user selects the points by 
clicking in panel 22 and once the desired points have been selected the user accepts 
the base points indicated at 34. Further options may also be provided, for example 
advancing the image displayed in panel 22 to the next frame. 
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It will be appreciated that the user does not need to define the axis by selecting the 
centre of the ventricle in the basal and apical slices. The user may instead define the 
centre of the left ventricle in two slices which are not the basal or apical slices. The 
5 software may then calculate the position of the long Etxis by defining a Une in 3- 
dimensional space between these two points. The length of the long axis of the left 
ventricle may then be calculated separately from the distance between the basal and 
apicfd slices if the spatial position of the slices is known. 

10 As shown at step 116 in Figure 1, the software defines a reference model of a left 
ventricle. The preferred reference shape closely approximates the generic shape of a 
left ventricle. The reference model may be constructed from real patient data, but 
does not have to be absolutely accurate in terms of an individual patient. The 
reference model may be defined as an analytical function, as a coordinate system, or 

15 as data points. 

The preferred reference model is a finite element model consisting of at least 16 
elements, typically 16 to 40, each with cubic interpolation in the circumferential and 
longitudinal directions. Linear interpolation is used to couple the endocardial and 

20 epicardial surfaces into a coherent 3-D model. The preferred model is defined in a 
polar coordinate system in which the radial coordinate of the model is fitted as a 
function of the two angular coordinates in the circumferential and longitudinal 
directions respectively. The preferred initial shap>e of the reference model is a regular 
ellipsoid, typically a prolate spheroid, obtained by setting the endocardial and 

25 epicardial surfaces to a constant radial value. The preferred reference model is 
scaled according to the length of the long axis of the left ventricle of the subject with 
the extent of the model in the longitudinal direction set to correspond to the point 
identified on the most basal slice of the left ventricle in the long axis, 

30 The preferred estimate model is obtained by a least squares finite element modelling 
process in which the left ventricle is divided into a number of rectangular segments 
or elements. Each element defines a bicubic spline surface for part of the 
endocardial and epicardial surfaces of the left ventricle. It is important to ensure 
continuity in the surface defined by adjacent elements. To ensure continuity, 

35 adjacent elements are constrained to have the same position and slope on each side 
of the join. Ensuring continuity in this way eliminates or at least reduces ridges and 
sharp transitions between adjacent elements. 
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Within each element, the geometric coordinate field x is given as a function of 
element or material coordinates ^ by a weighted average of nodal values: 



5 x(^,.e3.<S3) = Z^«('^p^a^U" (1) 

n 

where A" are the nodal values, 4^r> are the element basis functions which give the relative 
weighting of each nodal value, and (^p^2>^3) ^® element co-ordinates. 

10 The geometric Held A is defined to be the radial co-ordinates in the polate spheroidal co- 
ordinate system: 



jc = /cosh(A)cos(/i) 

y = /sinh(A)sin(/J)cos(0) (2) 
z = /sinh(A)sin(;i)sin(0) 

15 where (A,^,0)are the radial, longitudinal and circumferential co-ordinates of the 
polar system and (x, y, z) are the corresponding rectangular cartesian co-ordinates. 
The focal length f of the polate system is preferably chosen so that the A = 1 surface 
gives a good initial approximation of the left ventricular epicardial surface, providing 
an overall scale factor for the ventricle. 

20 

Previously defined points are used to determine the initial position of the model with 
respect to the images. These are: 

a) the location of the central axis at the center of the LV in an apical short axis 
25 " image 

b) the location of the central axis at the center of the LV in a basal short axis image 

c) the approximate centroid of the right ventricle 

d) a set of points describing the mitral valve plane. 

30 A model-based coordinate system is then constructed with the origin placed on the 
central axis of the LV one third of the distance from the base to the apex. Nodes are 
placed at equally spaced intervals in the two angular coordinates 0) and at a 
constant radial coordinate (X). The centroid of the RV has 8=0 and the extent of the 
jnodeLin the p. direction is governed bv the basal margin points. The distance from 
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apex to base is used to determine the focal length of the prolate system and provides 
an overall scale factor for the LV. 

Each guide point is projected onto the model along lines of constant \l and B and only 
5 the X field is fitted by linear least squares. 

As shown at 1 18 in Figure 1, the next step is to define one or more guide points on 
one or more slices for which the spatial positions have been defined. Referring to 
Figure 7 the user is presented with the option indicated at 38 of defining guide 

10 points. The user then selects and displays in panel 22 any one of the slices stored in 
the memory. The image of the subject organ is displayed in panel 22. A 
representation of the reference model is preferably superimposed on the image of the 
subject organ. In the preferred form, a representation of the intersection of the 
reference model with the image slice superimposed on the image slice, as indicated 

15 by contour lines 39 A and 39B. 

The user first selects the active surface which is being defined as indicated at 40. In 
Figure 8 the user has selected the left ventricular endocardial boundary as the active 
surface. Using a mouse, the user defines one or more boundary guide points on the 

20 selected slice by clicking in panel 22. These guide points, in combination with the 
reference model, define the endocardial or epicardial boundaries of the heart. 
Preferably three to four endocardial boundary guide points and three to four 
epicardial boundary guide points are entered for each slice, although the user is able 
to enter a large number of boundary guide points for a particular slice or may 

25 instead ignore a slice and enter no boundauy guide points for it. 

As the user defines the guide points, the system converts these guide points to three- 
dimensional coordinates from the image position in space for each boundary guide 
point, and fits the model by forcing the model to adhere closely to the guide points, 
30 as will be discussed below. 

Where a number of image frames are stored in memory, the user may advance to the 
next frame by clicking on the Next Frame option indicated at 43. 

35 Figures 9 and 10 further illustrate the process by which the boundary points are 
defined by the user. The user is defining the endocardial boundary of an image slice 
different to the one shown in Figure 7. In Figures 9 and 10 the user is defining the 
epicardial and endocardial boundaries respectively for a further image. 
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It will be appreciated that where an organ other than the left ventricle is to be 
modelled, the reference model will be varied. For example, where the invention is 
used to model the right ventricle, lung and/or kidney, a different reference model will 
5 be defined. 

The next step indicated at 120 in Figure 1 is to form an estimate model by fitting the 
reference model to the guide points. This process could be initiated automatically 
whenever the user selects the Next Frame option indicated at 43 in Figures 7 to 10, 
10 or may be updated automatically in real time with the insertion or deletion of a guide 
point or any change in guide point position. 

The preferred method for incorporating the reference model data is to minimise an 
error function consisting of the sum of a smoothing term and a term penalising the 
15 distance between each boundary guide point and the corresponding reference model 
position. 

The preferred smoothing term penalises changes in slope and curvature around the 
left ventricle, allowing the reference model to realistically interpolate guide pK>int data 
20 where the data is sparse. 

The preferred penalty is introduced into the least squaires method which penalises 
only the sum of the squared deviations from the boundary guide points to the 
reference model surface. In particular, the first and second derivatives of the 
25 surfaces are constrained to be minimised within the least squares fit to prevent 
rippling and other abnormalities. In this sense, the smoothing can be viewed as 
weighting the estimate model more toward the reference model than the boundary 
guide points so that the reference model is imposed more strongly where there are no 
or insufficient boundary guide points. 



One preferred smoothing method is set out more particularly below, in which 
the error function minimised is: 



30 




(3) 



35 where Ag are the positions of the guide point data and A(^^ ) are the model positions 
at element co-ordinates corresponding to . The element co-ordinates are 
preiei^^-*ly fovmd by projecting the giiio- * data onto the model along lines of constant 
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/i andd . S(X) denotes a smoothing term included in the error function to constrain 
the model to smoothly interpolate between the sparse guide points. 

S(X) is preferably a weighted Sobolev norm which penalizes the displacement of the 
5 estimate model from the reference model. 




10 where u = X - X* where X,* is the reference model. The weights ai and a2 penalize the 
slope of the displacement field in the circumferential and longitudinal directions 
respectively, the weights Pi and P2 penalize curvature and the weights yi, T2 and 73 
couple slopes between directions. Typical, smoothing weights are ai - a2 = O, Pi = P2 = 
0.001, Yi = Y2 = Y3 = 0.01. 

15 

The resulting estimate model incorporates endocardial and epicardial boundary 
guide points, the long axis of the left ventricle, reference model data and smoothing 
constraints to produce endocardial and epicardial left ventricular surfaces in three or 
four dimensions closely approximating the true surfaces represented in the images. 

20 

Having defined these surfaces, the software may then calculate the intersection of 
the image slices with the surfaces and display the estimate model as indicated at 122 
in Figure 1. The intersections are each represented by two lines, one line 
representing the endocardium and the other line representing the epicardium which 
25 are close to the edges on the images. 

Having calculated endocardial and epicardial surface boundaries on each image, 
image(s) are then evaluated, preferably by the user, for acceptable contours as 
indicated at 124 and acceptable image quality as indicated at 126. The software may 
30 then perform local image processing as indicated at 128 to further improve the 
quality of the left ventricle boundary edges displayed in the images. The use of local 
image processing is not essential to the invention. Where provided, it may be 
invoKea by the user. An edge is cnaracterized by an abrupt change in intensity 
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indicating a boundary, and is called a discontinuity. In general an edge is often seen 
as a slow change in grey level values between connected pixels. While a boundaiy 
edge may be readily apparent to the human eye, it can be difQcult for software to 
detect. 

5 

Prior art methods of detecting discontinuities or edges include running a mask or 
window over the image, or by applying a known edge enhancing filter such as a 
Roberts, Sobel or Laplacian operator. Appl3dng such a filter to an entire image in 
order to find boundary edges is computationaUy expensive, 

10 

Using the present invention, the endocardial and epicardial boundaries have been 
estimated with the estimate model. The software therefore can calculate the likely 
position of a boundary edge in an image. An a priori technique may then be applied 
to guide the search for the boundary in the image. 

15 

In one method, radial lines may be drawn extending through both the endocardial 
and epicardial boundaries. An edge filter may be applied at the intersection of these 
boundaries and the radial line to determine the points on the radial line most likely 
to represent the endocardial £ind epicardial edges. 

20 

Further local processing could cdso include thresholding, for example grey-scale 
thresholding. All pixel values falling between two threshold values Ti and T2 retain 
their grey-scale values but edl pixel values outside this interval are set to zero. Such 
multiple thresholds may be applied to reduce the number of grey-level values in an 
25 image, thereby enhancing the contrast. Thresholding may be applied, for example, to 
contrast the area in the image inside the endocardial boundaiy, from the area 
between the endocardial and epicardial boundaries, and/ or the area outside the 
epicardial boundary. 

30 Local image processing and thresholding as described above may generate additional 
data points which may be added to the existing boundaiy guide points. The estimate 
model contour may then be redefined based on the additioned data points so that the 
relationship to the actual images is improved. 

35 The additional data jjoints obtained from local image processing and thresholding 
may be assigned less weight than boundary guide points selected by the user, as it 
will be appreciated that these additional data points may be less reliable than those 
selected by the user. The generated ilata points may be displayed to the user in 
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order to identify where additional guide points are needed to improve the estimate 
model, for example, where a contour has missed the actual edge. 

It will be appreciated that where image processing is performed, it is performed at a 
5 local level. It is assumed that the edge is in a particular region. Image processing is 
computationally expensive and in the past has been performed on an entire image or 
slice. Using the invention, it is possible to determine the approximate position of the 
region so that image processing can be concentrated on that region, significantly 
reducing the processing time. Where the local image processing is unable to 
10 determine the location of an edge, the estimate model will be determined primarily 
from the guide points defined by the user, the reference model, and smoothing 
parameters. 

The software may then define the final estimate model surfaces from the finite 
15 element modelling process, with the inclusion of data points obtained by local image 
processing. The intersection of this surface with the image slices permits the 
software to display on the original images the left ventricular endocardial and 
epicardial boundary walls. The step of drawing the estimate model is indicated in 
Figure 1 at 122. 

20 

The number of guide points can be reduced substantially if the images are of good 
quality and the image processing is able to accurately define the edges and guide the 
estimate model on to them. 

25 As shown in Figure 2, the main window presents to the user the option of viewing the 
images in three dimensions, indicated at 54. On selecting this option the user is 
presented with a 3D viewer window as will be more particularly described with 
reference to Figures 11 and 12. 

30 Referring to Figure 1 1, the window includes panel 56 in which images are displayed. 
The user has the option of selecting image planes as the desired view as indicated at 
124. Where the Image planes option is selected, the user may select which image 
slices to display in panel 56. In Figure 1 1 the user has selected the long axis shce 
and the fifth short axis slice to display in panel 56. Also displayed in panel 56 are the 

35 intersections of the estimate model with the original image planes. 
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Referring to Figure 12, the user has elected not to display image planes. The image 
displayed in panel 56 is instead the estimate endocardial surface rather than 
individual image planes. 

5 Each boundary or contour is then assessed by the user for appropriateness. If the 
boundary or contour is unacceptable, the user may define further boundary guide 
points until such time as the boundary or contour is acceptable, as indicated in 
Figure 1 at 124. 

10 Left ventricular cardiac volume, for example, may then be estimated by calculating 
the volume bounded by the estimate model in the step indicated at 130 in Figure 1. 
Left ventiiculcir wall thickness may also be calculated from the estimate model. Left 
ventricular mass may be Ccdculated from the difference between the volumes 
enclosed by the endocardisd and epicardial contours multiplied by ein appropriate 

15 constant, for example 1.05 g/ml. 

It will be appreciated that the volume, wall thickness and mass of the right ventricle 
may also be calculated in the same way. Where more than one frame is stored in the 
memory, the method may be used to measure abnormalities in the left or right 
20 ventricle identified through changes in wall thickness over time. The system may 
also be arranged to calculate area, curvature, angles and other parameters from the 
estimate model. 

The method and system of the invention may further provide the results of 
25 measurement and Eoialysis in an intuitive, useful and interactive way that the 
cardiologist can understand and use in patient management. Referring to Figure 13, 
the system may display to a user the volumes of blood or muscle associated with 
each imaging slice. These volumes are preferably determined by calculating the area 
of the endocardium or epicardium from the estimate model for each slice and 
30 multipl3ring each area by the slice thickness. 

Individual slice identifiers are indicated at 80 in a display panel. By clicking in the 
appropriate box adjacent a slice identifier the user may view a graph indicated at 82 
of volume vs time for the mass, endocardium or epicardium respectively. Individual 
35 boxes indicated at 84 may display numerical values for end-diastolic and end- 
systolic volumes, mass, stroke volume and ejection fraction for each slice. 
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Figure 14 illustrates display of data similar to the data of Figure 13. In Figure 14 
regions or sections of the ventricle are displayed according to the standard 
definitions of the American Society of Echocardiographers. The data displayed in 
Figure 14 is useful to a cardiologist as the data is independent of the original scan 
5 planes. The data has been acquired by mathematically sampling the model in each 
of the regions. 

Figure 15 illustrates a further display in which the left ventricle has been folded out 
onto a flat surface and the wall thickness at every point mapped in a different colour 
10 or shade. This display cines through the cardiac cycle as wall thickness changes. 
Arbitrary user defined regions can be dravm onto the map and the results shown as 
a graph, for example regions A, B and C in Figure 14. The right ventricle insertion 
with the left ventricle is shown by the dots in the image of the left ventricle. Further 
buttons on the display switch different parts of the display on and off. 



The method may also be used to measure characteristics of other organs for example 
the lung, the kidney or may be used to measure the wall of a blood vessel. In the 
case of a kidney the method may be used to measure cortical thickness. 

20 In a further form the invention could be implemented on or associated with scanning 
apparatus. As the scanner produces images, an operator could insert guide points 
and update the estimate model. Areas of insufficient data could be identified 
automatic£dly and the scaimer directed to scan these planes automatically. 

25 The method and system of the invention are particularly suited to measuring 
characteristics of human subjects. It will be appreciated that the same method and 
system could be used to measure characteristics of organs of other mammals for 
example rodents, canines and primates. The same technique could also be applied 
- to the task of measuring the size and/ or geometry of a cell. 



The foregoing describes the invention including preferred forms thereof. Alterations 
and modifications as will be obvious to those skilled in the art are intended to be 
incorporated within the scope hereof as defined by the accompanying claims. 



15 



30 
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CLAIMS 

1. A method of measuring characteristics of an organ or part thereof from 

multiple images of the organ or peirt thereof, the method comprising the steps of: 
5 defining the spatial position of at least two of the images; 

defining a reference model of the organ or part thereof scaled according to 
the distance between reference markers on the images; 

defining one or more boundaoy guide points associated with one or more 
images for which the spatial positions have been defined; 
10 converting the guide points to three-dimensional coordinates; 

defining an estimate model by fitting the reference model to the guide points; 

and 

c£dculating the characteristics from the estimate model. 

15 2. A method as claimed in claim 1 wherein the distance between the reference 

markers is calculated by the steps of defining a point on each of two images; defining 
a reference line in 3 -dimensional space between the points; and calculating the 
distance as a function of the length of the reference line. 

20 3. A method as claimed in claim 2 wherein the reference model comprises a 

mathematically defined reference model defined in a polar coordinate system. 

4. A method as claimed in claim 3 wherein the reference model comprises an 
ellipsoid having the reference line as a central axis and one or more surface points, 

25 each surface point specified by a radial distance from the central axis. 

5. A method as claimed in any one of the preceding claims comprising the steps 
of displaying one or more images to a. user and superimposing on the image a 
representation of the intersection of the reference model with the image. 

30 

6. A method as claimed in claim 5 further comprising the step of performing 
image processing on one or more of the images. 

7. A method as claimed in cladm 5 or claim 6 wherein the user jjerforms the 
35 step of defining one or more boundary points on the image(s). 



wo 01/01859 



17 



PCT/NZ00/000d3 



8. A method as claimed in any one of the preceding claims further comprising 

the step of calculating the volume of the subject organ or part from the estimate 
model. 

5 9. A method as claimed in any one of the preceding claims further comprising 

the step of calculating the mass of the subject organ or part from the estimate model. 

10. A method as claimed in any one of the preceding claims wherein the subject 
orgEin comprises a ventricle of the heart and the characteristics measured include 

10 ventricular mass, endocardial volume and/or wall thickness of all of the ventricle or 
part thereof. 

11. A method as claimed in any one of the preceding claims wherein the subject 
organ comprises a ventricle of the heart and the characteristics measured include 

15 ventricular abnormalities identified through changes in wedi thickness over time. 

12. A method as claimed in any one of claims 1 to 9 wherein the subject organ 
comprises a kidney and the characteristics measured include cortical thickness. 

20 13. A system for measuring characteristics of an organ or part thereof of a 
subject from multiple images of the subject's organ or part thereof, the system 
comprising: 

a memory in which is stored the spatial position of at least two of the 

images; 

25 reference model definition means arranged to define a reference model of the 

orgcm. or part thereof scaled according to the distance between the reference markers 
on the images; 

boundary guide point definition means arrcinged to define one or more 
boundary guide points associated with one or more images for which the spatial 
30 positions are stored in the memory; 

conversion means arranged to convert the guide points to three-dimensional 
coordinates; 

estimate model definition means arranged to define an estimate model by 
fitting the reference model to the guide points; and 
35 calculation means arranged to calculate the characteristics from the 

estimate model. 
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14. A system as claimed in claim 13 wherein the reference model definition 
means is arranged to calculate the distance between the reference markers by the 
steps of defining a point on each of two images; defining a reference line in 3- 
dimensional space between the points; and calculating the distance as a function of 

5 the length of the reference line. 

15. A system as claimed in claim 14 wherein the reference model comprises a 
finite element model defined in a polar coordinate system. 

10 16. A system as claimed in claim 15 wherein the reference model comprises an 
ellipsoid having the reference line as a central axis and one or more surface points, 
each surface point specified by a radial distance from the central axis. 

17. A system as claimed in any one of claims 13 to 16 further comprising display 
15 means arranged to display one or more images to a user and to superimpose on the 

image a representation of the intersection of the reference model with the image slice. 

18. A system as claimed in claim 17 further comprising image processing means 
arranged to perform image processing on one or more of the images. 

20 

19. A system 3ls claimed in claim 17 or claim 18 wherein the boundary guide 
point definition means is arranged to obtain preferred guide point positions from a 
user. 

25 20. A system as claimed in any one of claims 13 to 19 further comprising volume 
calculation means arranged to calculate the volume of the subject organ or part from 
the estimate model. 

21. A system as claimed in any one of claims 13 to 20 further comprising mass 
30 calculation means arranged to calculate the mass of the subject organ or part from 

the estimate model. 

22. A system as claimed in any one of claims 13 to 2 1 wherein the subject orgEm 
comprises a ventricle of the heart and the cheiracteristics measured include 

35 ventricular mass, endocardial volume and/ or wall thickness of all of the ventricle or 
part thereof. 
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23. A system as claimed in any one of claims 13 to 22 wherein the subject organ 
comprises a ventricle of the heart and the characteristics measured include 
ventricular abnormalities identified through changes in wall thickness over time. 

5 24. A system as claimed in any one of claims 13 to 2 1 wherein the subject orgcin 
comprises a kidney and the characteristics measured include cortical thickness. 



25. A computer program for measuring characteristics of an organ or part 
thereof of a subject from multiple imeiges of the subject's organ or part thereof, the 

10 program comprising: 

storage means arranged to store the spatial position of at least two of the 

images; 

reference model definition means arranged to define a reference model of the 
organ or part thereof scaled according to the distance between the reference markers 
15 on the images; 

boundary guide point definition means arranged to define one or more 
boundary guide points associated with one or more images for which the spatial 
positions are stored in the memory; 

conversion means arranged to convert the guide points to three-dimensional 
20 coordinates; 

estimate model definition means arranged to define an estimate model by 
fitting the reference model to the guide points; and 

calculation means arranged to calculate the characteristics from the 
estimate model. 

25 

26. A program as claimed in claim 25 wherein the reference model definition 
mecins is arranged to calculate the distance between the images by the steps of 
defining a point on each of two images; defining a reference fine in 3-dimensional 
space between the points; and calculating the distance as a fiinction of the length of 

30 the reference line. 

27. A program as claimed in claim 26 wherein the reference model comprises a 
finite element model defined in a polar coordinate system. 

35 28. A program as claimed in claim 27 wherein the reference model comprises an 
eUipsoid having the reference line as a central axis and one or more surface points, 
each surface point specified by a radial distance fi-om the central axis. 
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29. A program as claimed in any one of claims 25 to 28 fixrther comprising 
display means arreinged to display one or more images to a user and to superimpose 
on the image a representation of the intersection of the reference model with the 
image. 

5 

30. A program as claimed in claim 29 further comprising image processing 
means arranged to perform image processing on one or more of the images. 

31. A program as claimed in claim 29 or claim 30 wherein the boundary guide 
10 point definition means is arranged to obtain preferred guide point positions from a 

user. 

32. A program as claimed in any one of claims 25 to 31 further comprising 
volume calculation means arranged to calculate the volume of the subject organ or 

15 part from the estimate model. 

33. A program as claimed in any one of clcdms 25 to 32 further comprising mass 
calculation means arranged to calculate the mass of the subject organ or part from 
the estimate model. 

20 

34. A program as claimed in any one of claims 25 to 33 wherein the subject 
organ comprises a ventricle of the heart and the characteristics measured include 
ventricular mass, endocardial volume and/ or wall thickness of all of the ventricle or 
part thereof. 

25 

35. A program as claimed in any one of claims 25 to 34 wherein the subject 
organ comprises a ventricle of the heart and the characteristics measured include 
ventriculcir abnormalities identified through changes in wadl thickness over time. 

30 36. A program as claimed in any one of claims 25 to 33 wherein the subject 
organ comprises a kidney and the characteristics measured include cortical 
thickness. 

37. A computer program as claimed in any one of claims 25 to 35 embodied on a 
35 computer readable medium. 
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